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Abstract — It is well-known that the eigenvalue spectrum of 
the Laplacian matrix of a network contains valuable infor- 
mation about the network structure and the behavior of many 
dynamical processes run on it. In this paper, we propose a fully 
decentralized algorithm that iteratively modifies the structure 
of a network of agents in order to control the moments of the 
Laplacian eigenvalue spectrum. Although the individual agents 
have knowledge of their local network structure only (i.e., 
myopic information), they are collectively able to aggregate this 
local information and decide on what links are most beneficial 
to be added or removed at each time step. Our approach relies 
on gossip algorithms to distributively compute the spectral 
moments of the Laplacian matrix, as well as ensure network 
connectivity in the presence of link deletions. We illustrate our 
approach in nontrivial computer simulations and show that a 
good final approximation of the spectral moments of the target 
Laplacian matrix is achieved for many cases of interest. 



I. Introduction 

A wide variety of distributed systems composed by au- 
tonomous agents are able to display a remarkable level 
of self-organization despite the absence of a centralized 
coordinator [1, 2]. For example, the structure of many 
"self-engineered" networks, such as social and economic 
networks, emerges from local interactions between agents 
aiming to optimize their local utilities [3]. Motivated by 
the implications of a network's Laplacian spectrum on 
its structure (i.e., number of connected components) and 
behavior of dynamical processes implemented on it (i.e., 
speed of convergence of distributed consensus algorithms), 
we propose a distributed model of graph evolution in which 
autonomous agents can modify their local neighborhood in 
order to control a set of moments of the network Laplacian 
spectrum. 

The eigenvalue spectra of a network provide valuable 
information regarding the behavior of many dynamical pro- 
cesses running within the network [4]. For example, the 
eigenvalue spectrum of the Laplacian matrix of a graph 
affects the mixing speed of Markov chains [5], the stability 
of synchronization of a network of nonlinear oscillators [6, 
7], the spreading of a virus in a network [8, 9], as well 
as the dynamical behavior of many decentralized network 
algorithms [10]. Similarly, the second smallest eigenvalue of 
the Laplacian matrix (also called spectral gap) is broadly 
considered a critical parameter that influences the stability 
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and robustness properties of dynamical systems that are im- 
plemented over information networks [11, 12]. Optimization 
of the spectral gap has been studied by several authors both 
in a centralized [13]-[15] and decentralized context [16]. In 
contrast, our approach focuses on controlling the moments 
of the Laplacian eigenvalue spectrum. In this way, we can 
influence the behavior of certain dynamical processes run 
within the network. As we show, the benefit of controlling 
the spectral moments, and especially the lower order ones, 
lies in lower computational cost and elegant distributed 
implementation. 

A major challenge in our approach is to efficiently control 
the spectral moments of a network in a fully distributed fash- 
ion while maintaining network connectivity in the presence 
of link deletions. Our work is related to [17], where a fully 
distributed algorithm is proposed to compute the full set of 
eigenvalues and eigenvectors of a matrix representing the 
network topology. However, our approach is computationally 
cheaper since computation of the spectral moments does not 
require a complete eigenvalue decomposition, but can be 
performed distributively by averaging local network infor- 
mation, such as node degrees. On the other hand, control of 
the network structure to the desired set of spectral moments 
is based on greedy actions (link additions and deletions) that 
are the result of distributed agreement protocols between 
the agents. We show that our distributed topology control 
algorithm is stable and converges to a network with spectral 
moments "close" to the desired. The performance of our 
algorithm is illustrated in computer simulations. 

The rest of this paper is organized as follows. In Sectionllll 
we formulate the problem under consideration and review 
some terminology. In Section |III1 we derive closed-form 
expressions for the first four moments of the Laplacian 
spectrum in terms of graph properties that can be measured 
locally. Based on these expressions, we introduce a dis- 
tributed algorithm to compute these moments. In Section HVl 
we propose an efficient distributed algorithm to control of the 
spectral moments of a network. Finally, in Section |V] we 
illustrate our approach with several computer simulations. 

II. Preliminaries & Problem Definition 

Let Q — (V, £) denote a graph on n nodes, where V = 
{vi, . . . ,Vn} denotes the set of nodes and £ C V x V is 
the set of edges. If {vi,Vj) e £ whenever {vj,Vi) S £" we 
say that Q is undirected and call nodes Vj and vj adjacent 
(or neighbors), which we denote by Vi ^ Vj. The set of all 
nodes adjacent to node v constitutes the neighborhood of 
node V, defined by Af" = {w <E V : {v,w) G £}, and 
the number of those neighbors is called the degree of node 
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V, denoted by deg v. In this paper, we consider finite simple 
graphs, meaning that two nodes are connected by at most 
one edge and self-loops are not allowed. 

We define a walk from vq to Vk of length k to be an ordered 
sequence of nodes {vo,vi, ...,Vk) such that Vi ^ w^+i for 
i = 0, 1, fc — 1. We say that a graph Q is connected if 
there exists a walk between every pair of nodes. If = '^fc, 
then the walk is closed. A closed walk with no repeated 
nodes (with the exception of the first and last nodes) is 
called a cycle. Triangles and quadrangles are cycles of 
length three and four, respectively. Let d {v, w) denote the 
distance between two nodes v and w, i.e., the minimum 
length of a walk from v to w. We say that v and w are 
k-th order neighbors if d{v,w) = k and define the fc-th 
order neighborhood of a node v as the set of nodes within 
a distance k from v, i.e., Af^ = {w G V : d{v,w) < k}. 
A fc-th order neighborhood, induces a subgraph C Q 
with node-set Af^ and edge-set £^ defined as the set of 
edges in £ that connect two nodes in A/^. We say that a 
graphical property Pg is locally measurable within a radius 
k around a node v if Pg is exclusively a function of the 
neighborhood subgraph, i.e., Pg ^ f (G^)- For example, both 
the degree and the number of triangles touching a node are 
locally measurable within a radius 1. Also, the number of 
quadrangles touching a node is locally measurable within a 
radius 2. 

Graphs can be algebraically represented via the adjacency 
and Laplacian matrices. The adjacency matrix of an undi- 
rected graph Q, denoted by Ag = [a^ ], is an n x n symmetric 
matrix defined entry-wise as = 1 if nodes Vi and vj 
are adjacent and = otherwise Q The powers of the 
adjacency matrix is related to walks in a graph. In particular 
we have the following results [18]: 

Lemma 2.1: The number of closed walks of length a 
joining node Vi to itself is given by the i-th diagonal entry 
of the matrix Ag. 

Corollary 2.2: Let ^ be a simple graph. Denote by Ti and 
Qi the number of triangles and quadrangles touching node Vi, 
respectively. Then {Ag)ii = 0, = degw,, = 

2T, and (4),^ = 2Q, + {dcgv.f + Z.em (dcg«j - !)■ 

Arranging the node degrees on a diagonal matrix yields 
the degree matrix Dg — diag (degVi). Then, the Laplacian 
matrix Lg of a graph G can be defined by Lg = Dg — Ag. 
Let Ai < A2 < ... < A„ be the eigenvalues of Lg, where 1 
is the vector of all ones. One can prove that Lg is positive 
semidefinite and Ai = 0. Furthermore, Q is connected if and 
only if A2 > 0, or equivalently, if kcr Lg = span{l} [18]. 
As a result, we have the following well-known result: 

Theorem 2.3 ( [19]): Consider a fixed undirected graph 
Q on n nodes and let 6i{t) £ R denote the state variable of 
node i. Let 9{t) = [di{t)] G M" be the vector of all states and 
assume d{t) = —LgO{t). Then the network Q is connected 
if and only if. 
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lim e{t) = - V6ii(0)l e span{l}. 



(1) 



i=l 



For simple graphs with no self-loops, an = for all i. 



for all initial conditions 6'(0) G K". 

Theorem l2.3l savs that the graph Q is connected if and only 
if all nodes eventually reach a consensus on their state values 
9i{t), for all initial conditions. Therefore, connectivity of a 
network Q can be verified almost surely by comparing the 
asymptotic state values ([T]i of all agents, for any random 
initialization. Note that a similar result can be obtained 
by application of a finite-time maximum (or minimum) 
consensus [20]. 

A. Problem Definition 

Consider a discrete-time sequence of graphs {Q{s)}s>i 
where s £ {1,2,...} is the discrete time index. We denote 
by {Ai(s)}s>i the set of Laplacian eigenvalues of G{s). We 
define the fc-th spectral moment of the Laplacian matrix of 
G{s) at time s as: 



n 



Similarly, the fc-th centralized spectral moment of the Lapla- 



cian can written as: 



1 

n ^-^ 

1=1 



mi (s))'' 



The first four centralized spectral moments of the Laplacian 
corresponds to the mean, variance, skewness and kurtosis of 
the eigenvalue spectrum and they play a central role in this 
paper. Define further the error function: 



CME (g(s)) 



k=0 



1/k 



1/k 



(3) 



where denotes a given set of desired centralized mo- 
ments. Since the fc-th moment is the fc-th power-sum of 
the Laplacian eigenvalues, we include the exponents 1/fc in 
the above error function with the purpose of assigning the 
same dimension to the summands in (O. Then, the problem 
addressed in this paper is: 

Problem 1: Given an initially connected graph G{0), de- 
sign a distributed algorithm that iteratively adds or deletes 
links from G{s), so that the connectivity of G{s) is main- 
tained for all time s and the error function CME(C?(s)) is 
locally minimized for large enough s. 

In what follows, we first propose a distributed algorithm to 
efficiently compute and update CME(C/(s)) without any ex- 
plicit eigendecomposition (Section HIHi. Then, in Section ITVl 
we propose a greedy algorithm where the most beneficial 
edge addition/deletion is determined based on a distributed 
agreement over all possible actions that satisfy network 
connectivity (Theorem 12.3b . In this framework, the time 
variable s increases by one whenever an action is taken 
(i.e., an addition or deletion of a link). For simplicity, we 
assume that actions are taken one at a time, although this 
assumption can be relaxed to accommodate more complex 
action schemes. 
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III. Distributed Computation of Spectral 
Moments 

In what follows, we assume that the agents in the network 
have very limited knowledge of the network topology. In 
particular, we assume that every agent v only knows the 
topology of the second-order neighborhood subgraph around 
it, 02 ■ (This is the case, for example, for many online social 
networks, where each individual can retrieve a list of his 
friends' friends.) Then, computing the first four Laplacian 
spectral moments relies on counting the presence of certain 
subgraphs, such a triangles and quadrangles, in every agent's 
neighborhood and averaging these quantities via distributed 
average consensus. In particular, since the matrix trace opera- 
tor is conserved under diagonalization (in general, under any 
similarity transformation) the first three spectral moments of 
the Laplacian matrix of a graph can be written as 

"^fe(ie) = ^ti-4 = itr {Dg-Agf 
N n 



1 " 

-E 



AY tr [AlD^-n, 



(4) 



for fc < 3, where we have used the fact that the trace is 
preserved under cyclic permutations (i.e., tr ADD=\i DAD= 
tr DDA). We cannot use Newton's binomial expansion for 
the forth moment; nevertheless, we may still obtain the 
following closed form solution: 

1 4 
TO4 (Lg) = -tT{Dg - Ag) 
n 

= ^[tr(^^)-4tr(i?3^g)+4tr(i?^4) 

+2tr (DgAgDgAg) - 4tr (DgAl) + tr (A^)] 
Expanding the traces that appear in (HJi and (|5]l we get 

n 



and 



(5) 



71 n 



tr (DgAgDgAg) = 2^ 2^ (dcgViaij) (dcgvjaji) 

1=1 3 = 1 



71 n 



^ ^ (dcg deg Vj) a,j ^ ^ deg v, ^ deg Vj , 

1=1 j=i 4=1 jeAfi 

which substituted back in equations (HJi and (|5j give the 
following expression for fc < 3 



71 E E yj. 

i=l r=0 



(-!)'■ (deg«0'^"'"(^e).,- (6) 



For fc = 4, we can also simplify the Laplacian spectral 
moment, which now becomes 



TO4 



1 " 

(^e) = - E [(deg«.)' - 4 [degv.f (Ag)^ 

i=l 

+4 (deg Vif {Ag)^^^ + 2 deg v, ^ deg Vj - 



Substituting the expressions for {Ag)^^ form Lemma IZTI 
and Corollary 12.21 in equations ^ and ^ we obtain the 
first four spectral moments of the Laplacian matrix Lg as a 
function of the second-order neighborhood subgraphs only 



1 " 

™i (Lg) = - V'degWi, 
n ^ — ' 

i=l 
1 " 

"^2 (Lg) = - {dcgv^f + degVi 
n ^ — ' L 

2=1 
1 " 

^3 (ic?) = - E f(dcg «»)^ + 3 (deg v^f - 2T, 
n — ' L 

i=l 
1 " 

™4 (Lg) = - (degwi)" + 4 (degui)^ + (degv.f 



(8a) 
(8b) 
(8c) 

(8d) 



-A{degv.){Ag)l + {Ag)l 



(7) 



- deg Vi + (2 deg + 1) ^ deg Vj - 8Tj deg + 2Qi 

Note that the expressions for the spectral moments in 
equations (O are all averages of locally measurable quan- 
tities (within a 2-hop neighborhood), namely, node degrees, 
triangles and quadrangles touching the node. Hence, we can 
apply consensus and use the result of Theorem 12.31 to obtain 
the first four moments in a distributed way. 

IV. Distributed Control of Spectral Moments 
A. Possible Local Actions 

The possible actions (or control variables) we consider are 
local link additions and local link deletions. A link addition 
is local if it connects a node with another node within its 
second-order neighborhood. Since agents in the network only 
know their local neighborhood, a fully distributed algorithm 
must limit edge additions to be local. (One could extend the 
algorithm to allow connections between nodes being further 
than two hops away, but this option would require much 
more computation and communication.) 

Let A/'i(.s) and A/'2(s) denote the sets of neighbors and 
two-hop neighbors of node i at time s > 0, respectively. 
Since any of the two nodes adjacent to a link can take an 
action to delete that link, we need to decide which of the two 
nodes has the authority to delete the link. To avoid ambigu- 
ities, we define the set of edges that node i has authority 
to remove as: f^(s) ^ {(«,.?) G f(s) | j £ A/'i(s), i > j}. 
Similarly, to disambiguate between nodes adding a (still 
non-existing) link between them, we define the set of 
potential edges that node i can create as: f^(s) = 
{(ij) G Sis) I j G ^^i{s)\^flis), l > jji in other words, 
node i can either add a link {i,j) G £l{s), or delete a 
link {i,j) G £^{s)- Note that link deletions may violate 
network connectivity. In this case, those link deletions should 
be excluded from the set of allowable actions. In the next 
two sections we address the cases of link deletions and link 
additions separately. 

^Note that since the indices of all nodes in the network are distinct, this 
definition results in a unique assignment of links to nodes. 
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1 ) Link Deletions: Network connectivity is typically in- 
ferred from the number of trivial eigenvalues of the Laplacian 
matrix. However, such approaches are not applicable in 
our framework, since we assume no global knowledge of 
the network topology Q{s), but only knowledge of local 
neighborhoods. Instead, we employ finite-time-maximum 
consensus which is a distributed algorithm and converges 
to equal values on nodes belonging to the same connected 
component of a graph (Theorem 12.3b . Therefore, if deletion 
of a link violates connectivity, both nodes adjacent to that 
link will lie in different connected components and will have 
different consensus values. In what follows, we extend this 
idea to simultaneously checking connectivity for all possible 
edge deletions in the graph using a single high-dimensional 
consensus algorithm. 

Consider node j that has authority to remove any of the 
links in the set f;^(s). Each one of these links needs to be 
checked with respect to connectivity and each connectivity 
verification relies on a scalar consensus update, according to 
Theorem 12. 3 1 Therefore, checking all links in £^^{s) requires 
\£^{s)\ consensus updates|l We associate with every link in 
£^{s) a consensus variable, and stacking all these variables 
in a vector we obtain the state vector Xjj(s) G Rl^rf^'''^l. 
Running a distributed consensus over the network, requires 
participation of all other nodes i ^ j. This is possible by 
defining the state variables Xij{s) G Rl^d(''*)l. All vectors 
Xij(s) are initialized randomly and are updated by node i 
according to the following maximum consensus: 
Case I: If (i,.?) ^ ^ nodes i and j are 

not neighbors, then 

Xij(s) := max {x^ (s), x^j (s)} , (9) 

with the maximum taken elementwise on the vectors. 
Case II: If (i, j) £ i.e., if nodes i and j are neighbors 

and node j has authority over link (i, j), then 

[^^3{s)](^,j) ■■= , max {[X.y(s)](,^j), [Xfcj(s)](,j)} , 



max {[x,j(.s)](,j), [xfcj(s)](,j)} , (11) 
feeA/]'(s) 

for I i, where [x^j G ^ denotes the entry of x^j (s) 

corresponding to the link 

Case III: If (i, j) G £j^{s), i.e., if nodes i and j are neighbors 
and node i has authority over link (i, j), then 

[X"(s)](*,i) := max {[xri(s)](,j), [xfc,(s)](ij)} . 

(12) 

Once consensus (l9b-(fT2b has converged, node i compares 
the entries [x,i{s)\ij) and [xjj(s)](jj) for all G 
£^{s). Since, violation of connectivity due to deletion of 
the link would result in nodes i and j being in dif- 

ferent connected components of the network, [xu{s)](^ij) = 

^We define by |X| the cai'dinality of the set X. 



Algorithm 1 Connectivity verification 

Require: x^^ G MI^^I for all j eV ; 
Require: Tij = [0 . . . 1^ . . . 0]^, V j G V; 

1: if 3 j G V such that min{Ty} = then 

2: Update Xij by (l9b-(fT2li: 

3: Tij := maxfcg^i {T^ , Tkj}; 

4: else if mm{Tij} = 1 for all j G V then 

5: Update £'^ by ([T3; 

6: end if 



[xji(s)](i implies that the reduced network is still con- 
nected. Hence, we can define a set 

SUs) = {(hj) G £K,s)|[x,,(s)](,.,) = [x,,(,s)](,^,)} , (13) 

containing the safe links adjacent to node i that if deleted, 
connectivity is maintained. 

2) Connectivity Verification: The connectivity verification 
of link deletions, discussed in Section lTV-A.ll is illustrated in 
Alg. [U Convergence of the finite-time consensus (l9]l- (fT2] | is 
captured by a vector of tokens Tij{s) G {0, 1}", initialized 
as T,j{s) := [0 . . . 1^ . . . 0]^ for all j G V and indicating 
that node i has initialized the consensus variables for link 
deletions for which node j is responsible. In particular, 
when all tokens of all nodes have been collected (line 4, 
Alg. [TJ, then consensus has converged and the set of safe 
link deletions £^{s) can be computed (line 5, Alg. [T]). Note 
that node i does not need to know the neighbor sets of its 
non-neighbors in the network, neither their size. Instead, the 
vectors Xy (s) are initialized both in values and dimension 
as soon as vectors Xkj{s) are received from a neighbor 
k G A/7(s). Clearly, Xjj{s) are initialized first and then 
propagated in the network via maximum consensus until the 
information they contain reaches node i. 

B. Most Beneficial Local Action 

As discussed in Problem[T] the objective of this work is to 
minimize the error function CME{Q{s)). For this we propose 
a greedy algorithm, which for every time s selects the action 
that maximizes the quantity CME(C/(s))-CME(C/(s + l)), if 
such an action exists, and terminates if no such action exists. 
By construction, such an algorithm converges to a network 
that locally minimizes CME(^y(s)), while in Section |Vj we 
show that it performs well in practice too. 

In what follows we first compute the effect of a link 
addition or deletion on the four first spectral moments. 
Although distributed consensus could be used to compute 
the new moments resulting from each possible action, as 
in Section Hill this would clearly be computationally very 
expensive. Instead, we can achieve this goal locally and with 
minor computational overhead, based on the observation that 
the addition or removal of an edge only influences the 
degrees of nodes i and j, as well as and the triangles and 
quadrangles touching their neighboring nodes. Hence, agents 
i and j can communicate to compute the net increment in 
the spectral moments due to the addition or deletion of edge 
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(i, j). In particular, we get the following expressions for the 
increments in the first three moments 



Algorithm 2 Globally most beneficial action 



[0...1,...0]^; 



T. 



n 

2 



Amf = ^ [1 ± (d. + d,' + 1)] , 
n 



AmJ''-^' = - [(3 ± 6) (di + dj) ± 3(d- + dj) + (6 ± 2) =F 6Tij 



where the notation ± (i, j) indicates a link addition (+) or 
deletion (— ) and the dependence on time s has been dropped 
for simplicity. (Similarly, one can obtain a complicated 



Require: 
Require: Ti 

1: if min{r,} = tlien 

2: Vj, with j = max{argminfcg^,{[vi]3, 

3; Ti ~ maXjg^,{ri,T,}; 
4: else if miii{Ti} = 1 and [v^Ja < D then 
5: Update Mi, and CME, according to (fl4]i-(fT7Ti: 
6: else if min{Ti} = 1 and [v.;] 3 = D then 
7: No beneficial action. Algorithm has converged; 
8: end if 



closed-form expression for Am 



which we omit due to C. From Local to Global Action 



space limitations.) Then, agent's i copy of the fc-th spectral 
moment m\.{s) becomes 

and the associated centraUzed moment fhf^^'-'\s) can be 
computed using Then, for all possible actions discussed 
in Section IIV-AI agent i computes the error function 



CME 



±ih3) 



^ r 
(s) (m 



k=0 



1/k 

is)] -{nil) 



l/k 



Then, the local most beneficial action to the target centralized 
moments, namely, the action that results in the maximum 
decrease in the error function CME( ), can be defined b}Q 

Vi{s) = max|argmin (CME±(ij){s) — CMEi(s))| , 

where CMEi(.s) denotes agent i's copy of CME(s), and the 
largest decrease in the error associated with action Vi{s) 
becomes: 

CME,(s) =CME±(,,,^(,))(s) 

if minj(CME±(jj)(s) - CME(s)) < and CMEi(s) = D, 
otherwise. Note that CMEi(s) is nontrivially defined only if 
the exists a link adjacent to node i that if added or deleted 
decreases the error function CME( ). Otherwise, a large value 
D > is assigned to CMEi(.s) to indicate that this action 
is not beneficial to the final objective. We can include all 
information of a best local action in the vector 

v,(s) = [^ v^{s) CME,(s) m±(,^^,(,)) (s)] e 

containing the local best action {i,Vi{s)), the associated 
distance to the desired moments CME,;(s), and the vector 
of centralized moments rn-|-(i ^,.(5)) (s) due to this action. In 
the following section we discuss how to compare all local 
actions Vi(s) for all nodes i G V to obtain the one that 
decreases the distance to the desired moments the most. 

''The max in the expression bellow indicates that in case of ties in the 
min, the highest index node wins. 



To obtain the overall most beneficial action, all local 
actions need to be propagated in the network and compared 
against each other. For this we require minimal storage and 
communication as well as no propagation of any information 
regarding the network topology. As in Section IIV-AI we 
achieve this goal using a finite time minimum consensus 
algorithm. 

In particular, the desired local actions Vi(s) are propagated 
in the network, along with vectors of tokens Ti{s) G {0, 1}", 
initialized as Tj(s) := [0 . . . Ij . . . 0]^, indicating that node i 
has transmitted its desired action. During every iteration of 
the algorithm, every node i communicates with its neighbors 
and updates its vector of tokens Ti{s) (line 3, Alg.O, as well 
as its desired action Vi(.s) with the action Vj(s) correspond- 
ing to the node j that contains the smallest distance to the 
target moments [vj(s)]3, i.e., 

j e argminfcgj^^;(^){[vi(s)]3, K(s)]3}. 

In case of ties in the distances to the targets [vj(s)]3, i.e., if 
argmin^.g^.(^){[vi(s)]3, [vfc(s)]3} contains more than one 
nodes, then the node j with the largest label is selected 
(line 2, Alg. |2]l. Note that line 2 of Alg. |2] is essentially a 
minimum consensus update on the entries [vi(s)]3 and will 
converge to a common outcome for all nodes when they 
have all been compared to each other, which is captured by 
the condition min"^^Ty (s) = 1 (fines 4 and 6, Alg. 
When the consensus has converged, if there exists a node 
whose desired action decreases the distance to the target 
moments, i.e., if [vi(s)]3 < D (fine 4, Alg. IS, then Alg. |2] 
terminates with a greedy action and node i updates its set of 
neighbors Ml{s) and vector of centralized moments mi(s) 
(line 5, Alg. |2|i. If the optimal action is a link addition, i.e., 
if [v.(s)]2 ^M{{s), then 



Nl{s + l) :=AA^(.)U{[v,(.)]2} 



(14) 



On the other hand, if the optimal action is a link deletion, 
i.e., if [vj(s)]2 e Miis), then 



Nl{s + l) :=AA^(.)\{[v,(.)]2}, 



(15) 



In all cases, the centralized moments and error function are 
updated by 

m,(s + l) := [v,(s)]4:7 (16) 



6 



Reset 3 



Reset 1 



Run 1 



Run 2 



Run 3 



Reset 2 

Fig. 1 . Synchi'onization: Assume node j is in run 1 . Necessary for node i to 
transition to run 2 is that all otlier nodes are also in run 1, since otherwise 
node i will be missing tokens from the nodes that are not in run 1 yet 
(currently in run 3) and Alg. |2] will not be able to converge. Once node i 
transitions to mn 2, it initializes all variables for that ran with the latest 
values from ran 1, while it maintains the variables of ran 1 for nodes that 
ai'e still in ran 1 and it clears all variables of ran 3 since, no node is in this 
ran any more. 



and 



CMEi(s + l) := [v,(s) 



(17) 



respectively, where [vi(s)]4:7 = [[vi(s)]4 ■ ■ • [vj(s)]7] . Fi- 
nally, if all local desired actions increase the distance to the 
target moments, i.e., if [vi(s)]3 = D (line 6, Alg.|2]i, then no 
action is taken and the algorithm terminates with a network 
topology with almost the desired spectral properties. This is 
because no action exists that can further decrease the distance 
to the target moments. 

D. Synchronization 

Communication time delays, packet losses, and the asym- 
metric network structure, may result in runs of the algorithm 
starting asynchronously, outdated information being used for 
future decisions, and consequently, nodes reaching different 
decisions for the same run. In the absence of a common 
global clock, the desired synchronization is ideally event 
triggered, where by a triggering event we understand the 
time instant that a message Msg[z] has been received by 
any of node i's neighbors j G A/^- We achieve such a 
synchronization by labeling every algorithm run in the set 
{1,2,3} and requiring that all information exchange takes 
place among neighbors that are in equally labeled runs [21]. 
Essentially, "fast" nodes wait for their "slower" peers and, 
hence, all nodes are always synchronized in the sequence 
{1,2,3,1,2,3,...} (Fig.D. 

V. Numerical Simulations 

In this section we illustrate our algorithm with several 
numerical examples. 

Example 1 (Star networks): Consider a star network on 
10 nodes. The first four central moments of the associated 
Laplacian matrix are: m* = 1.8, = 7.56, rfig = 54.14, 
and = 453.49. Our objective is to control the topology 
of a randomly initialized network on 10 nodes so that it 
eventually has the same set of moments as the given star 
network. We observe in Fig. |2] that our algorithm decreases 
the error function (blue line) to zero in finite time. Similar 
performances are observed when we repeat this procedure for 
star networks of any size. Furthermore, although we are con- 
trolling the first four moments solely, the resulting network 
structures are exactly the star topologies whose moments 
we were trying to approximate. The perfect reconstruction 
observed in this case is due to the fact that a star graph is a 
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Fig. 2. Convergence of the error function CME(-) for the star graph 
(blue plot) and the two-stars graph (red plot). The subgraph in the upper 
right corner shows the behavior of the error function in a neighborhood of 
zero. Observe that our algorithm can match the first four moments of the 
star network with zero error in finite time, but can not exactly match the 
moments of a the two-stars graph, although the final error is very small. 





Fig. 3. Stractures of the two-stars network (a) and the network returned 
by our algorithm (b). 



extreme case in which the graph topology is uniquely defined 
by their eigenvalue spectrum. Moreover, if each agent in a 
star network has access to its second-order neighborhood, it 
has access to the complete star topology. 

Example 2 (Two-stars network): Although our approach 
works very well for star networks, the case of two-stars 
networks points out one of its weaknesses, namely, its lim- 
itation in modeling network communities. In this example, 
we consider two star graphs on 10 nodes each, and connect 
their two central hubs with a link. The resulting graph is the 
two-stars graph shown in Fig. [3ja). As before, we initialize 
our algorithm with a random graph on 20 nodes and try 
to approximate the first four central moments of the two- 
stars graph. In Fig.|2l we observe that the error function (red 
line) quickly reaches a neighborhood of zero but does not 
reach zero exactly. Therefore, although our algorithm tries 
to generate the two hubs in the two-star network, its local 
nature will not allow it recover the highly-structured two- 
stars graph. Instead, it returns the final network shown in 
Fig. Ob). Nevertheless, the eigenvalue spectra between the 
desired two-star network and the network in Fig. [3lb) are 
still very similar, as shown in Fig. H) 

Example 3 (Chain vs. ring networks): The objective of 
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Fig. 4. Empirical cumulative distribution functions for the eigenvalues of 
the two-stars graph (blue) and the graph returned by our algorithm (red). 



this example is to illustrate how two structurally very similar 
(but topologically different) target graphs, such as a chain 
and a ring, may affect the performance of our algorithm. In 
particular, if we run our algorithm to control the first four 
centralized moments of an initially random graph towards the 
moments of a chain graph, we observe how the error function 
converges exactly to zero in finite time. Furthermore, the 
final result of our algorithm is an exact reconstruction of 
the chain graph. Nevertheless, when transforming the target 
graph from a chain graph into a ring graph (by adding 
a single link), an exact reconstruction is very difficult. In 
Fig. |5] we illustrate some graphs returned by our algorithm 
for different initial conditions when we control the set of 
moments toward the moments of a ring network on 20 nodes. 
Observe that, although the algorithm tends to create long 
cycles and the majority of nodes have degree two, it fails to 
recreate the exact structure of the ring graph due to the local 
nature of the algorithm (as in Example |2]i. However, although 
the structure of the resulting networks is not exactly the 
desired ring graph, their spectral properties are remarkably 
close to those of a ring. In Fig. |6l we illustrate the empirical 
cumulative distribution functions of the eigenvalues of the 
ring graph (blue plot), versus the four empirical cumulative 
distribution functions corresponding to the graphs in Fig. |5] 
Example 4 (Small-Worlds): In our final example, we use 
our algorithm to control the moments of a randomly gener- 
ated graph to those of a small-world network. We consider 
small-world graphs as defined in [22], namely, we take a 
ring of n nodes, and connect each node in the ring with 
all the nodes in its 3-hop neighborhood. Then, we randomly 
rewire a fraction of the resulting edges with probability p 
as proposed by Watts and Strogatz [22]. Our objective is to 
approximate the first four centralized moments of a random 
instance of a small world graph with n = 40 nodes and link 
probability p = 1/n. We observed a fast convergence of the 
error to a neighborhood of zero, i.e., CME(27 iterations) = 
.0009, which suggests (although does not guarantee) a good 
approximation between the spectra of the target small-world 
graph and the graph returned by our algorithm. We repeated 
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Fig. 5. Networks returned by our algorithm when trying to match the first 
four central moments of a ring on 20 nodes. 
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eigenvalues 

Fig. 6. Empirical cumulative distribution of eigenvalues for the ling graph 
with 20 nodes (blue plot) and the graphs in Fig.lSja) (red). Fig. (Jib) (green). 
Fig. [sjc) (magenta) and Fig. [Sjd) (cyan). 

this process for a link probability p = 4/n and similar results 
were obtained. We should note, however, that although the 
spectral properties between the target small-world graphs and 
the graphs returned by our algorithm are remarkably similar 
(Fig. |7]i, we expect the structures to be quite different as in 
Example [3] (although this difference is not easy to observe 
from a direct visualization of both graph structures). 

VI. Conclusions and Future Research 

In this paper, we have described a fully decentralized al- 
gorithm that iteratively modifies the structure of a network of 
agents with the objective of controlling the spectral moments 
of the Laplacian matrix of the network. Although we assume 
that each agent has access to local information regarding the 
graph structure, we show that the group is able to collectively 
aggregate their local information to take a global optimal 
decision. This decision corresponds to the most beneficial 
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Fig. 7. Empirical cumulative distrubution of eigenvalues for the small- 
world graphs in the example for p = 1/n (left) and p = A/n (right). 

link addition/deletion in order to minimize an error function 
that involves the first four Laplacian spectral moments of the 
network. The aggregation of the local information is achieved 
via gossip algorithms, which are also used to ensure network 
connectivity throughout the evolution of the network. 

Future work involves identifying sets of spectral moments 
that are reachable by our control algorithm. (We say that a 
sequence of spectral moments is reachable if there exists a 
graph whose moments match the sequence of moments.) Fur- 
thermore, we observed that fitting a set of low-order moments 
does not guarantee a good fit of the complete distribution of 
eigenvalues. In fact, there are important spectral parameters, 
such as the algebraic connectivity, that are not captured by a 
small set of spectral moments. Nevertheless, we observed in 
numerical simulations that fitting the first four moments of 
the eigenvalue spectrum often achieves a good reconstruction 
of the complete spectrum. Hence, a natural question is to 
describe the set of graphs most of whose spectral information 
is contained in a relatively small set of low-order moments. 
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